ERGONOMIC AUXILIARY SCREEN AND DISPLAY SUBSYSTEM FOR 
PORTABLE HANDHELD DEVICES 



BACKGROUND OF THE INVENTION 
5 The present invention relates generally to screens for portable handheld devices 

such as personal digital assistants (PDAs). More specifically, it concerns an ergonomic 
screen that increases the legibility, clarity and aesthetics in graphic, iconic and textual 
presentation. 

Portable handheld devices are among the latest in a line of digital devices that 
1 0 extend connectivity and networking to previously uncharted limits. Rapid development 
in new and revolutionary technologies has imparted many features into today's portable 
handheld devices such as cell phones, personal digital assistants (PDAs), etc., to 
empower the consumer with the ability to stay continuously informed, irrespective of 
location. This rapid technological advancement, along with increasing demands from 
1 5 consumers, is expected to lead to handheld devices with capabilities far surpassing those 
of current PDAs. For example, PDAs now provide for world-wide web (Internet) 
connectivity, web browsing and even formidable personal computing. Most experts 
agree that the information era will further transform every aspect of how people use these 
devices remotely to play, work, write and read. Enormous personal, avocational and 
20 business opportunities will be spawned by the digital revolution in the form of such 
devices. 

While technology endeavors to provide a multitude of features in a handheld 
device, no comparable improvement has been made in the ease of use of such devices, 
e.g. screen legibility. The screen size of handheld devices has been constrained while 
25 expansion of the handheld devices' capabilities has produced undesirable screen clutter, 
excessive scrolling requirements and busy and confusing graphics. There is an urgent 
need to develop an ergonomically improved display subsystem in handheld devices for 
more legibility, clarity and aesthetics, while accommodating a multitude of device 
features, 

30 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is an isometric view of a portable handheld device featuring an ergonomic 
display subsystem in accordance with one embodiment of the invention. 

Fig. 2 is an isometric view of an alternative embodiment of the invented portable 
5 handheld device. 

Fig. 3 is a schematic block diagram of the device of Fig. 1 or 2 illustrating a 
screen image video memory management scheme employed by an embodiment of the 
invention. 

Fig. 4 is a flowchart illustrating the method of the invention in one embodiment 

10 thereof 

DETAILED DESCRIPTION OF THE INVENTION 
The invention provides a novel display subsystem, e.g. an auxiliary screen and 
associated electronics, for handheld devices, e.g. personal digital assistants (PDAs) or 
cellular telephones or pocket personal computers (PCs), that provides a feasible solution 
15 for the above, thereby greatly enhancing the ergonomics for the user. 

Figs. 1 and 2 illustrate in isometric view two alternative embodiments of invented 
display subsystem 10, of which two different embodiments are indicated in Figs. 1 and 2 
respectively at 10a and 10b. 

The invention proposes a display subsystem 10a or 10b including a movable 
20 auxiliary screen 12a or 12b (generally designated 12) in addition to the conventional 
main screen 14 found in otherwise conventional handheld portable device 16. 

Referring briefly to Fig. 1, display subsystem 10a may be seen to include an 
pivotable auxiliary display 12a that folds out and opens up to provide screen area in 
addition to that of main display 14. Auxiliary display 12a is hinged to a body portion 
25 16a of device 16 which will be understood typically to include a housing containing the 
device's electronics. This is based upon most current designs where main display 14 is in 
an upper region of a face of device 16. Referring briefly to Fig. 2, display subsystem 
10b may be seen to include a slidable auxihary display 12b that sHdes in and out of a 
body portion 16a of device 16, e.g. behind main display 14. Those of skill in the art will 
30 appreciate from a brief review of Figs. 1 and 2 that auxihary displays 12a, 12b 

substantially increase, e.g. approximately double or better, the available screen area in a 
portable handheld device. 
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Device 16 may be seen also to include a keyboard or data entry device, indicated 
at 18 in Figs. 1 and 2, Keyboard or data entry device 16 may alternatively take the form 
of a cursor control device such as a stylus, joystick, mouse pad or the like, effectively 
enabling selection by the user of one or more pushbuttons or controls. (Those of skill in 
5 the art will appreciate that the use of a stylus is typically in conjunction vv^ith a soft, or 
screen-rendered, keypad or menu pushbutton or icon, etc.) One or more of the keys or 
pushbuttons of keyboard 16 will be understood to be configured for key entry to effect 
pixel image displays on one or more of main display 14 or auxiliary display 12, as will 
be explained below by reference to Fig. 3. Within the spirit and scope of the invention, 
10 main display 14 alternatively may be a touch-screen display, which, for example, with 
the use of a stylus or other pointer device, effectively permits data entry or selection by 
the user. 

Those of skill in the art will appreciate that device 16 may have an altemative 
form and altemative or additional features not shown in Figs. 1 and 2. For example, 
15 device 16 may take the form of a cellular telephone or a pocket PC, and may have one or 
more input/output (I/O) ports for operative connection with other devices. Such I/O 
ports may be infrared (IR), radio frequency (RF) or any other electronic conveyance, or 
may include more conventional wired ports such as serial or parallel connector jacks or 
plugs for cables. 

20 In one preferred embodiment of the invention, auxiliary screen 12 is used 

exclusively for display purposes. Thus, optional touch-screen features are constrained to 
main screen 14 in the body of the device. This is because pressing repeatedly on 
auxiliary screen 12, as would be required by a typical touch-screen, might impart 
undesirable cantilever forces on the hinge/joints attaching auxihary screen 12 to body 

25 portion 16a of device 16. Such might produce reliability problems, which may be 
avoided. 

Referring still to Fig. 1, a first embodiment of the invention is shown in which 
auxiliary screen 12a is hinged to pivot into and out of viewing position as needed. (Fig. 
1 indicates by the use of phantom outline that the screen faces inwardly, i.e. it confronts 
30 the main screen when stowed (i.e. when the auxiliary screen is pivoted flat against the 
body of the hand-held device) and faces outwardly, i.e. it augments the main screen for 
viewing when deployed (i.e. when the auxiliary screen is pivoted away from, and 



Patent Application 



Page 3 



DO. NO. 5038-68 



preferably into parallel alignment with, the body of the hand-held device).) First, it will 
be appreciated that the hinged auxiliary screen 12a is made to pivot, in accordance with 
one embodiment of the invention, up and down. In other words, in accordance with this 
embodiment, the pivotal axis is horizontal relative to the handheld device (held in 
5 accordance with its intended use) and is located adjacent a top edge thereof. 

Those of skill in the art will appreciate, however, that, within the spirit and scope 
of the invention, auxiliary screen 12a may be made to attach anywhere on body portion 
16a of portable handheld device 16 and to pivot around any axis relative thereto, whether 
vertical, horizontal or another orientation. In an exemplary alternative embodiment, the 

10 auxiliary screen may attach along a vertical side of the body portion of a portable 

handheld device to produce a book-style PDA having an auxiliary screen. In another 
exemplary alternative embodiment, the auxiliary screen may attach along a horizontal 
median of the body portion of a portable handheld device to produce a flip-style cell 
phone having an auxiliary screen. 

15 Fig. 1 also illustrates in phantom outline— near the hinged attachment of auxiliary 

display 12a to body portion 16a of device 16— a helically wound ribbon cable 20 for 
physically enabling pixel data from a video memory within device 16 to be presented on 
auxiliary display 12. It will be understood that the helical winding is around an axis 
parallel with the axis of the hinge that pivotally mounts auxiliary display 12a to body 

20 portion 16a. Those of skill in the art will appreciate that such a helical winding of 

flexible ribbon cable 20 (as is used in some laptop PCs) has proven to provide reHable 
pixel data conveyance, high durability and long life. 

While the helically wound ribbon cable configuration is described herein as 
representing one embodiment of the invention shown in Fig. 1, alternative 

25 interconnection schemes are contemplated. For example, those of skill in the art will 
appreciate that a nominally flat ribbon cable may be used to provide the needed 
input/output (I/O) interconnection between pixel data memory and the auxiliary display. 
Such an alternative flat ribbon cable arrangement is shown in Fig. 2 to be described 
below. (It will be appreciated that a flat ribbon cable, as used in pivotable auxiliary 

30 display 12a of Fig. 1, would tend also to curve or spiral around the hinge axis as the 

display is pivoted between its deployed and stowed positions. Thus, such an ahemative 
embodiment also is referred to herein as a spiral wound cable configuration.) 
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Preferably, the design of the interconnection takes into account cost, bandwidth, and 
durabihty considerations. (For example, it is preferred that the cable provide adequate 
strain relief when flexed, i.e. when the pivotable auxiliary display of Fig. 1 is stowed or 
when the slidable auxiliary display of Fig, 2 is deployed. It also is preferred that the 
5 cable not cause interference when relaxed, i.e. when the pivotable auxiliary display of 
Fig. 1 is deployed or when the slidable auxiliary display of Fig. 2 is stowed.) Preferred 
embodiments thus are flat, spiral or helical ribbon cables dimensioned and configured 
(like the helical ribbon cable illustrated in Fig. 1 and like the flat ribbon cable illustrated 
in Fig. 2) to flex without undue strain or slack during pivotal movement of auxiliary 

10 display 12a between its stowed and deployed positions. Any suitable interconnection 
means is within the spirit and scope of the invention. 

Preferably, main and auxiliary displays 12 and 14 are low-cost, high-performance 
flat panel displays such as electro-luminescent or liquid crystal displays (LCDs) or other 
suitable technology. Preferably, of course, to maintain a slender profile and substantially 

15 confine the auxiliary display within the perimeter of the hand-held device, at least when 
the auxiliary display is in its stowed position, both the main and auxiliary displays are of 
a thin, flat panel type. Displays 12 and 14 alternatively may operate at a lower 
performance level or be of higher cost, within the spirit and scope of the invention. 

Fig. 2 shows a second, alternative embodiment of the invented display subsystem 

20 in which auxiliary screen 12b slides into and out of the body portion 16a, e.g. the 

housing, of handheld device 16 as needed. It may be seen from Fig. 2 that a preferably 
flat, flexible ribbon cable 22 is used to route pixel data and address information form the 
display video memory to the main and auxiliary displays. Ribbon cable 22 preferably 
extends as illustrated between the top edge of main display 14 to the bottom edge of 

25 auxiliary display 12. This will be understood to minimize the path taken by the ribbon 
cable and simplify routing thereof. Those of skill in the art will appreciate that auxiliary 
display 12 preferably slides into a longitudinal slot 24 formed within device 16 behind 
main screen 14. Ribbon cable 22 may be routed through internal guides affixed therein, 
and when auxihary display 12 is deployed for viewing, as illustrated in solid hues in Fig, 

30 2, it preferably is disposed through a substantially 180° turn within the body of device 
16. When auxiliary display 12 is stowed within the body of device 16 (as indicated in 
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phantom in Fig. 2 by dashed hnes) ribbon cable 22 will be understood preferably to lie 
flat against the face of auxiliary display 12 within slot 24. 

Fig. 3 illustrates a screen video memory management scheme by which the 
display subsystems' alternative embodiments find particular utility. Specifically, the 
5 schematic block diagram shows that device 16 includes a microprocessor 26 and a 

memory 28 including first and second video memories representing contiguous blocks of 
memory for main display 14 and relatively movable auxiliary display 12. It also includes 
an interface (I/F) 30 therebetween for enabling pixel data from the display video 
memories to the displays; an optional hardware (H/W) rendering mechanism 32 for 

10 reading data from the video memories and mapping them to the screens; and an optional 
high-speed (streaming) video replay mechanism 34 for high-speed, hardware-assisted 
loading of pixel data video memory. It also includes a user input device or mode control 
mechanism, e.g. keyboard 18, operable to control the configuration of the pixel data 
within the dual-screen video memory. 

15 It will be appreciated that interface 30, hardware rendering mechanism 32 and 

video replay mechanism 34 may be provided, within the spirit and scope of the 
invention, in the alternative or in any suitable combination, depending upon the desired 
functionality and cost goals. 

Interface 30 is used herein to describe any interface that conveys pixel data 

20 signals from memory 28 to main and auxiliary displays 14, 12, whether high- or low- 
performance and whether high- or low-cost. Thus, interface refers broadly to any video 
bus and wiring scheme, such as those used in laptop PCs or currently available PDAs or 
pocket PCs. 

Hardware rendering mechanism 32 is used to describe any suitable hardware 
25 assistance mechanism that increases the bandwidth, refresh speed, graphic capability or 
performance aesthetics of the main or auxiliary display. In other words, hardware 
rendering mechanism 32 may act as a graphic processing unit (GPU) that performs video 
co-processing functions concurrent with normal processing by processor 26. 

Video replay mechanism 34 is used to describe any high-speed video mechanism 
30 that increases the overall video bandwidth between memory and the main or auxiliary 
displays 14, 12. Such may be useful in rendering television-quality motion picture 
monitoring capability to hand-held portable device 16. 
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Those of skill in the art will appreciate that I/O signal routing from memory 28 to 
auxiliary display 12 may be dependent upon, i.e. slaved to, that of the I/O signal routing 
to main memory 14 (as suggested in Figs. 1 and 2), or that it may be entirely independent 
therefrom (as suggested in Fig. 3). In other words, auxiliary display 12 need not 'piggy 
5 back' on main display 14, but instead may have its own physical and logical pixel data 
access to memory 28. The routing of pixel data from memory to one or more displays 
may take any suitable form, within the spirit and scope of the invention. Signal routing 
or layout density problems may be avoided by increasing the signaling layers in a printed 
circuit board (PCB) that mounts the memory and routes such signals via I/O pins to the 
10 displays, by time-multiplexing the pixel data routed to the displays over fewer signal 
lines. 

For example, the video bus between main and auxihary displays may be time- 
duplexed. Or one or the other of the video buses driving the displays may themselves be 
time-multiplexed (thereby to reduce VO signal count by a desirable factor). Other 

15 suitable techniques for increasing the effective I/O density are contemplated, although it 
is appreciated that typically such techniques may reduce I/O bandwidth. 

Finally, device 16 may include an external I/O section 36 operatively coupled 
with microprocessor 26 for providing any input/output options, e.g. flash memory, serial 
or parallel port, etc. Such I/O control and physical I/O ports may be of conventional 

20 design and utility. For example, a satellite antenna and transmitter/receiver may be 
provided in case portable, hand-held device 16 takes the form of a cellular telephone. 
Or, an I/R or edge connector hot sync port may be provided in case portable, hand-held 
device 16 takes the form of a portable PC or PDA. Other optional features and 
communication functions are contemplated, and are within the spirit and scope of the 

25 invention. 

The method of the invention now may be understood by reference to Fig. 4. The 
method preferably includes 100) in a portable, hand-held device augmenting display 
video memory to provide an auxiliary display video memory. The method also 
preferably includes 1 02) providing an auxiliary display integral with the device and 
30 coupled with the auxiliary video memory. Finally, the method preferably includes 104) 
providing the device with a dual-screen video memory management mechanism for 
concurrent routing of pixel data to the main and auxiliary displays. Preferably, the 
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auxiliary display is movably, e.g. pivotally or slidably, mounted for deployment or 
stowage to a body portion of the portable, hand-held device. 

Finally, those of skill in the art will appreciate that the invented method and 
apparatus described and illustrated herein may be implemented in software, firmware or 
5 hardware, or any suitable combination thereof Preferably, the method and apparatus are 
implemented in a combination of hardware and firmware, for purposes of low cost and 
flexibility. Thus, those of skill in the art will appreciate that parts of the method and 
apparatus of the invention may be implemented by a computer or microprocessor process 
in which instructions are executed, the instructions being stored for execution on a 
10 computer-readable medium and being executed by any suitable instruction processor. 

Alternative embodiments are contemplated, however, and are within the spirit and scope 
of the invention. 

Having illustrated and described the principles of our invention in a preferred 
embodiment thereof, it should be readily apparent to those skilled in the art that the 
15 invention can be modified in arrangement and detail without departing from such 
principles. We claim all modifications coming within the spirit and scope of the 
accompanying claims. 
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